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Abstract —Evolutionary Algorithms (EAs) have been shown to 
be powerful tools for complex optimization problems, which are 
ubiquitous in both communication and big data analytics. This 
paper presents a new EA, namely Negatively Correlated Search 
(NCS), which maintains multiple individual search processes in 
parallel and models the search behaviors of individual search 
processes as probability distributions. NCS explicitly promotes 
negatively correlated search behaviors by encouraging differences 
among the probability distributions (search behaviors). By this 
means, individual search processes share information and co¬ 
operate with each other to search diverse regions of a search 
space, which makes NCS a promising method for non-convex 
optimization. The cooperation scheme of NCS could also be 
regarded as a novel diversity preservation scheme that, different 
from other existing schemes, directly promotes diversity at the 
level of search behaviors rather than merely trying to maintain 
diversity among candidate solutions. Empirical studies showed 
that NCS is competitive to well-established search methods in 
the sense that NCS achieved the best overall performance on 
20 multimodal (non-convex) continuous optimization problems. 
The advantages of NCS over state-of-the-art approaches are also 
demonstrated with a case study on the synthesis of unequally 
spaced linear antenna arrays. 

Index Terms —Evolutionary Algorithms, Negative Correlation, 
Diversity Maintenance, Optimization in Communication Systems 


1. Introduction 

T he design or application of a communication system of¬ 
ten requires solving a challenging optimization problem. 
For example, minimizing the Symbol-Error-Rate (SER) for 
Amplify-and-Forward Relaying Systems is non-trivial since 
the SER surface is non-convex and has multiple minima Q. 
When tuning the protocol of sensomets Q, as mathematical 
modeling of sensomets involves numerous inherent difficulties, 
one might has to deal with the optimization problem without 
an explicit objective function and the quality of candidate 
protocol configurations could only be obtained from a sim¬ 
ulation model. In the era of Big Data, as data analytics (e.g., 
machine learning) fast grows into a ubiquitous technology 
in many areas, including communications, the challenges 
brought by complex optimization problems become even more 
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important than ever. First, one of the major roles of big 
data analytics is to acquire knowledge from data in order to 
facilitate decision-making, e.g., managing network resources 
based on the analysis of user profiles to achieve higher end- 
users satisfaction Q. Thus, the value of big data usually needs 
to be created through tackling an optimization problem (i.e., to 
seek the optimal decision), which is formulated based on the 
knowledge obtained from big data analytics. Such optimization 
problems may not only be non-convex, but also be noisy due 
to the noise contained in the original data. Furthermore, the 
data analytics process may also involve complex optimization 
problems, such as training deep neural networks 0 or tuning 
the hyper-parameter of Support Vector Machines 0. To 
cope with these complex optimization problems, Evolutionary 
Algorithms (EAs) have been widely adopted and been shown 
to be a family of powerful tools 0,0,0- In short, to create 
business values from big data analytics, optimization tools are 
indispensable. 

EAs search in the solution space of a problem by iteratively 
generating a population of new candidate solutions until a 
predefined halting condition is met. The use of population 
(rather than generating a single solution at each iteration) 
has been proved to be critical to the success of EAs both 
theoretically 0 and empirically 0. In particular, it is widely 
believed that information should be shared among individual 
solutions in the population, so that they can cooperatively 
generate new, hopefully more promising, candidate solutions 
and the algorithm could eventually search more effectively. 
The key research issues here are what information to share 
and how. In the literature, such a design philosophy is mainly 
implemented either by directly combining two or more can¬ 
didate solutions to generate new ones using the so-called 
reproduction operators |T0| , or by employing the population to 
build probabilistic models for generating new solutions (TT). 

In this paper, we propose a new population-based search 
method, namely Negatively Correlated Search (NCS). The 
core idea of NCS is a new model for implementing the 
cooperation between individuals in a population, which was 
inspired by an interpretation of cooperation in human behav¬ 
iors. That is, when a team of people is tackling a complex 
task, members of the team tend to work cooperatively by 
handling different parts of the task and communicate to avoid 
multiple members working on the same part. Analogously, 
NCS comprises multiple search processes. The search pro¬ 
cesses are run in parallel and strive to find better candidate 
solutions, while information is shared to explicitly encourage 
each search process to emphasize the regions that are not 
covered by others. 

In Section II, we will describe the general idea of NCS. 
Since the core idea of NCS is closely related to another 
important research issue, namely diversity maintenance, of 
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EAs, Section III will further discuss the novelty of NCS in 
this aspect by comparing its core idea with existing diver¬ 
sification schemes. After that, a concrete implementation of 
NCS for continuous optimization problems, namely NCS-C, 
will be detailed in Section IV. In Section V, the advantages of 
NCS-C will be demonstrated through comparisons with other 
stochastic search methods on challenging benchmark prob¬ 
lems. Section VI further demonstrates the potential of NCS 
on a real-world problem, namely the Synthesis of Unequally 
Spaced Antenna Arrays (SUSAA). Finally, conclusions will 
be drawn in Section VII. 

II. General Framework of Negatively Correlated 
Search 

We consider a population-based search process as multiple 
iterative search processes that are run in parallel. Each iterative 
search process basically consists of 3 procedures. First, one or 
more initial solutions are created randomly. Then, a random¬ 
ized search operator, e.g., the crossover or mutation operator of 
a Genetic Algorithm (GA), is applied to the current solutions 
to iteratively generate new candidate solutions. Finally, the 
search terminates when a predefined criterion is met. Many 
existing population-based search method can be formulated 
in this way as long as there exists some kind of relationship 
between solutions generated in different iterations. 

Intuitively, any population-based search method captured by 
the above procedures could be viewed as a multi-agent system 
GD in which every agent (i.e., a search process) strives to 
find a solution with better quality in terms of the value of the 
objective function of an optimization problem. Cooperation 
between the agents is expected to facilitate the search. Various 
strategies could contribute to designing a cooperation scheme 
for this purpose. The one adopted in NCS is that different 
agents should cover different regions of the search space and 
have different search behaviours. Specifically, NCS expects 
each search process to move towards a region that is both 
promising and is unlikely to be searched by other search 
processes, as elaborated below. 

For the sake of simplicity, we consider a special case that 
each search process is a Randomized Focal Search (RES), 
which produces one new candidate solution in each iteration. 
In other words, we consider a population-based search method 
with population size of N{N > 1), which runs N RES 
procedures in parallel and iteratively updates each individual 
solution in the population with a randomized search operator. 
Suppose at the fth iteration of NCS, N new solutions have 
been generated by applying some randomized search operators 
to N current solutions, respectively. Since randomized search 
operators are employed to generate new solutions, the search 
bias of a RES in the f-l-lth iteration is essentially a probability 
distribution from which a new solution will be sampled. 
Hence, if the probability distribution corresponding to a RES 
differs from those corresponding to the other RESs, it is likely 
to generate solutions in a region that is less likely to be 
covered by other RESs. This requires measuring the difference 
or correlation between two probability distributions, for which 
the Bhattacharyya Distance GD can be employed. Eqs. (1) and 


(2) gives the Bhattacharyya distance for two continuous and 
discrete probability distributions, respectively: 


DB{Pi,Pj) = - In ^ y ^Jpi{x)pj{x)(ix^ (1) 

\/pi(x)Pi(x)j (2) 

xGX ^ 

where pi and pj denote the probability density functions of 
two distributions. In case that the probability density function 
is not explicitly known, one may randomly generate a set 
of candidate solutions for both distributions and estimate the 
Bhattacharyya distance using the Bhattacharyya coefficient. 

Let Xi denote the current solution obtained by the ith RES 
and X- denote the new solution generated based on x^. At 
each iteration, one of the two solutions will be selected for 
generating another new solution in the next iteration and the 
other will be discarded. The probability distribution associated 
with the ith RES in the next iteration depends on the search 
operator and the solution kept, i.e., either x^ or x'. Hence, 
by choosing a solution to keep, the ith RES actually chooses 
one of the corresponding distributions, denoted as pi and 
p[. Ideally, the selected solution should be with high quality 
and should lead to a distribution that is distant from those 
corresponding to the other RESs. In NCS, the former can 
be measured with the value of the objective function to be 
minimized, denoted as /(x). The latter is defined as: 


DB{Pi,Pj) = - In 


Corr{pi) = mm{DB{pi,Pj)\j 7 ^ i} (3) 

J 

where pj represents the distributions corresponding to other 
RESs and a larger Corr{pi) is preferred. 

Determining an appropriate trade-off for the above cases can 
be difficult because /(x) and Corr{p) may be of different 
scales and /(x) may take negative values while Corr{p) is 
always non-negative. Hence, non-negative objective function 
values need to be first guaranteed by subtracting the minimum 
objective function value achieved so far from /(x^) and /(x-). 
Then, normalization is conducted by requiring /(x^) + /(x-) 
and Corr{pi) + Corr{p[) equal to 1. With the normalization 
step, it is no longer necessary to involve /(x^) and Corr{pi) 
for deciding which solution to discard because they now equal 
to 1 — /(x^ and 1 — Corr{p[), respectively. The smaller 
the /(x-), the better x- is in the sense of solution quality 
(assuming we are solving minimization problems). The larger 
the Corr{p[), the less likely that x- will result in new solutions 
that are close to the solutions generated by other RESs. Thus, 
NCS prefers the solution x- associated with small f{x[) and 
large Corr{p[), and the following heuristic rule is adopted in 
NCS to integrate the solution quality and correlation between 
RESs into one selection criterion: 


discard Xi, if < A 

discard x', otherwise 
where A G (0, -hoc) is a parameter. 


( 4 ) 
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To summarize, NCS maintains a population of RLSs and 
iteratively generates new solutions. At each iteration, each 
RLS is employed to generate one new solution. The new 
solution is then compared with the solution generated by the 
same RLS in the previous iteration. One of the two solutions 
will be discarded according to Eq. (4). The search terminates 
when a predefined halting condition is satisfied. 

III. NCS AS A Diversity Maintenance Approach 

The search mechanism of NCS can be made clearer by 
putting it into the general background of EAs, where the 
trade-off between exploration and exploitation is probably 
the most widely discussed issue (T4). Specifically, most EAs 
maintain the diversity of a population to control the exploration 
power, so as to promote search in new promising regions 
and avoid premature convergence (T4). Existing strategies 
for diversity maintenance can be categorized into two types: 
(1) The niching techniques ng such as fitness sharing and 
crowding, aim to select a set of solutions that are distant from 
one another in the solution space. These solutions will then 
be utilized to generate new solutions. This type of methods 
neglects the fact that a set of diverse (distant) solutions does 
not necessarily produce a diverse set of new solutions, since 
the latter also depends on the search operators used. (2) 
Alternatively, search operators with a large search step size 
could be employed periodically to generate new solutions that 
are likely to be more distant to the current solutions p^ . In 
the extreme case, the whole population could be randomly 
initialized Og. However, this type of methods will introduce 
another algorithm design problem that is difficult to address 
in practice. That is, which (large step-size) search operators 
should be used and when to switch between operators with 
different search step-sizes during the search process to achieve 
a good trade-off between exploration and exploitation. 

The core idea of NCS could be viewed as a novel diversity 
maintenance scheme. However, the diversity in the NCS 
framework is very different from the diversity in other cases, 
e.g., niching. Almost all other work defines diversity as diver¬ 
sity among individual solutions, e.g., genotypic diversity, while 
NCS defines diversity in terms of search behaviors, i.e., the 
probability distributions associated with RLSs. It is the search 
behaviour, which captures the on-going interaction between 
search operators and solutions, that really matters, not how 
a population of solutions ’’looks” (i.e., genotypic diversity). 
In certain sense, the concept of diversity in NCS bears some 
similarity to that in negative correlation learning p^ . In this 
way, NCS explicitly prefers solutions that are likely to produce 
diverse good solutions, although the selected solutions are not 
necessarily distant from one another in the solution space. 
Since the ultimate goal of diversity maintenance is to promote 
search in new promising regions, NCS is more directly related 
to this goal and thus is expected to facilitate the search better. 
Moreover, even if a fixed search operator is used throughout 
the search process, NCS is capable of pushing a RLS to visit 
regions that are seldom covered by other RLSs. Hence, NCS 
does not rely on fine-tuned coordination of different search 
operators to maintain diversity. 


IV. An instantiation oe NCS for Continuous 
Optimization 

In this section, an instantiation of NCS for continuous 
optimization is presented to illustrate the detailed steps of a 
NCS algorithm. 

A. Solution Representation and Search Operators 

Suppose a D-dimensional continuous minimization problem 
with objective function /(x) is to be tackled. In NSC-C, a 
solution is represented as a D-dimensional real-valued vector. 
The Gaussian mutation operator eg is employed as the search 
operator for all RLSs in NCS-C. Given an existing solution 
x^, the Gaussian mutation operator generates a new solution 
x- using Eq. (5): 


+ A/'(0,cri) (5) 

where Xid denotes the dth element of x^ and A/'(0, ai) denotes 
a Gaussian random variable with zero mean and standard 
deviation In general, the value of can be adapted 
during the search and may also vary over RLSs or even 
dimensions. To keep the algorithm simple, all RLSs in NCS- 
C are initialized with the same value of cr^. Then, each cji 
is adapted for every epoch iterations according to the 1/5 
successful rule suggested in |T9| , as given in Eq. (6): 


r 

if 

c 

epoch 

> 0.2 

(Ji^r 

if 

c 

< 0.2 

epoch 

Gi 

if 

c 

= 0.2 

epoch 


where r is a parameter that is suggested to be set beneath 
1, and c is the times that a replacement happens (i.e., x- is 
preserved) during the past epoch iterations. Eq. (6) is designed 
based on the following intuition. A large c implies that the RLS 
frequently found better solutions in the past iterations, and the 
current best solution might be close to the global optimum. 
Thus, the search step-size should be reduced (by r times). 
On the other hand, if a RLS frequently failed to achieve a 
better solution in the past iterations, it might have been stuck 
in a local optimum. In this case, the search step-size will be 
increased (by r times) to help the RLS explore other promising 
regions in the search space. 

According to Eq. (5), the Gaussian mutation operator gener¬ 
ates a new solution based on each x^ following a multivariate 
normal distribution. The expectation of the distribution is x^ 
and the covariance matrix T,i is cr|l, where I is the identity 
matrix of size D. Hence, given two solutions x^ and Xj, the 
Bhattacharyya distance given by Eq. (1) can be written as Eq. 
(7) (page 99, Eq. 3.152): 


DBiPhPj) = 


i(xi-Xj)'^S i(xi-Xj) 


det X) 


In 1 / 

2 V y^det Si det S, 


(7) 
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where T, = . 

Subsequently, the criterion given in Eq. (4) can be computed 
by considering the Bhattacharyya distance between x- and all 
the Xj generated by the other RLSs. 

B. Adaptation of Parameter A 

Given and x', Eq. (4) shows that different values of A 
may lead to different decisions on which solution will be 
kept/discarded. Thus the value of A can affect the search 
process and consequently the performance of NCS. Setting 
A to 1 indicates that the solution quality and correlation 
between RLSs are equally emphasized and hence can be used 
as the default setting. However, different values of A might be 
suitable at different stages of the search. Hence, a time-variant 
A is employed in NCS-C. Specifically, at the late stage of the 
search, each RES tends to shrink its search step size, and thus 
Xi and X- may take similar values of /(x) and Corr{p). In 
this case, Eq. (4) is highly sensitive to A since c^rr^p') 
converging towards 1. In contrast, the difference between x^ 
and X- in terms of ^ is relatively larger in the early 

stage of the search. Accordingly, a A away from the default 
setting might be beneficial. Eor these considerations, NCS-C 
randomly samples a Gaussian distribution with expectation 1 
to generate values of A at each iteration. The standard deviation 
of the Gaussian distribution is first initialized to 0.1, and then 
shrink towards 0 according to Eq. (8) 

At=V(l,0.1-0.1*;^) (8) 

^ max 

where T^^ax is the user-defined total number of iterations for 
an execution of NCS-C. 

Algorithm iQ outlines the pseudo-code of NCS-C. A popu¬ 
lation of solutions will be randomly initialized and evaluated at 
lines 1-2. Then, the algorithm will iteratively repeat lines 5-25 
until Tmax iterations have been conducted. At each iteration, 
the control parameter A in Eq. (4) is first set according to Eq. 
(8) at line 6. Then, new solutions x's are generated by applying 
Eq. (5) to X and evaluated with respect to both objective 
function / and correlation Corr according to Eqs. (3) and 
(7), as described at lines 7-10. The best solution found will be 
updated at lines 12-14. Since / and Corr may be of different 
scales, the two terms are normalized by requiring /(xi)+/(x') 
and Corr{pi) +Corr(p') equal to 1 before line 15. Lines 15- 
17 decide whether to replace x with x' based on Eq. (4). Eor 
every epoch iteration, lines 20-24 update the search step-size 
for each RES based on Eq. (6). Einally, the best solution found 
during the entire search process will be output when the search 
terminates at line 26. 


Algorithm 1 NCS-C( T^ax^ epoch, N) 


1 : 

2: 

3: 

4: 

5: 

6: 

7: 

8 : 


9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 


Randomly generate an initial population of N solutions. 
Evaluate the N solutions with respect to the objective 
function /. 

Identify the best solution x"^ in the initial population and 
store it in BestEound. 

Set t i — 0 

While it < Tmax) do 
Set At ^ Mil, 0.1 - 0.1 * 

For i = 1 to 

Generate a new solution x' by applying Gaussian 
mutation operator with gi to x^. 

Compute f{x[),Corr{pi) and Corr{p[). 

EndFor 

For i = l to N 

If fiA) < /(x*) 

Update BestEound with x'. 

Endlf 

Tf / i^'i ) ^ \ 

Corr{p'P) t 

Update Xi with x'. 

Endlf 

EndFor 

t i — t -|- 1 

If mod(t, epoch) = 0 

For i = 1 to N 

Update Gi for each RES according to the 1/5 
successful rule. 

EndFor 
Endlf 
EndWhile 
Output BestEound 



V. Computational Studies 

To assess the potential of NCS, computational studies have 
been carried out to compare the NCS-C against a number of 
well-established population-based search methods, including 
GA, Particle Swarm Optimizer (PSO) pT| , Evolution Strate¬ 
gies (ES) 1^, Differential Evolution (DE) and Scatter 

^The Matlab code of NCS-C can be downloaded at: 
http://staff.ustc.edu.cn/~ketang/codes/NCS.htnil 


Fig. 1: The Top-K, K =1,2„9, curves of the algorithms. 

Search (SS) Eor each of these algorithms, a correspond¬ 
ing state-of-the-art version is chosen for comparison, i.e., GL- 
25 im, CLPSO lig, CMA-ES SaDE ||27l and the SS 
1^ , respectively. Eurthermore, two well-known individual- 
based search methods. Simulated Annealing (SA) p8| and 
Tabu Search (TS) | |29| , are also included because of their 
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appealing performance in practice. Besides, a variant of NCS- 
C that omits the negative correlation between RLSs, denoted 
as Parallel Hill-Climbing (PHC), is created in order to verify 
the impact of the negative correlations between RLSs on the 
NCS-C. The parameters of the above-mentioned compared 
algorithms were set following suggestions in the literature, as 
detailed below. 

A. Algorithm Settings 

To make the comparisons fair, a candidate solution was 
represented as a real-valued parameter for all the compared 
algorithms. SA and TS were implemented with the same 
Gaussian mutation operator, in which the cr-s were initialized 
to one-tenth of the range of the decision variables. The 
parameters r and epoch in Eq. (5) were set to 0.99 and 10, 
respectively. A deterministic cooling schedule was used to 
control the Temperature of SA. Specifically, the temperature 
was initialized to 1 and then decreased with a factor 0.85 for 
every 100 iterations 1^ . The TS in was used and the 5 
most recently generated solutions were kept in the Tabu list. 
Following its standard procedure the size of ReferenceSet 
was set 10 for SS and all pairs of solutions in the ReferenceSet 
were recombined to generate new candidate solutions in each 
iteration. The 1-point crossover operator was employed as 
the recombination operator. The Gaussian mutation operator 
was also applied to each newly generated solution to further 
improve them. In this experimental study, the standard CMA- 
ES was compared. GL-25 is a hybrid real-coded genetic 
algorithm. It first runs the global search during the 25% of 
the computational budget, and then executes the local search. 
The initial population size for the global search is 400, while 
the local search improves the 100 best solutions output by the 
global search. In CLPSO, the velocity of a particle is updated 
by exploiting the personal historical best information of all the 
particles. In SaDE, both the trial vector generation schemes 
and the associated control parameters were self-adapted by 
gradually learning from the previous experiences in generating 
promising solutions. The population sizes of CLPSO and 
SaDE were set to 40 and 50, respectively. The PHC copies 
all the components of NCS-C, except for the calculation of 
negative correlations between RLSs. In other words, in PHC, 
the fitness function is regarded as the only criterion when 
discarding solutions. In addition to A, the population size of 
NCS-C also needs to be predefined. In the experiments, it was 
set to 10, i.e., the same as SS. 

B. Experimental Protocol 

We are mainly interested in multimodal optimization prob¬ 
lems since it is this type of problems that motivates the 
invention of most population-based search methods. The 20 
multimodal continuous problems in the benchmark set (num¬ 
bered as F 6 -F 25 ) for the CEC2005 competition on real- 
parameter optimization p 0 | were used in our empirical stud¬ 
ies. The dimensionality of each problem was set to 30. Each 
compared algorithm terminates when 300 thousands solutions 
have been generated and the best solution obtained so far 
was the final solution. The quality of the final solution is 


measured with function errors, i.e., the difference between 
the objective function value of the obtained solution and that 
of the optimal solution to the problem (which are known 
for these benchmark problems). That is, a better solution 
corresponds to a smaller function error and a zero function 
error indicates that the optimal solution is found. Since all 
the compared algorithms are stochastic search methods, we 
repeated the experiment for each algorithm for 25 times. The 
function errors of the corresponding solutions were recorded 
and the average function errors achieved by the 9 algorithms 
are presented in Table I together with the standard deviations. 

C. Analyses of Results 

The results presented in Table I show that none of the 
9 compared algorithms achieved the best results (in terms 
of average function errors) in all cases. Hence, two-sided 
Wilcoxon rank-sum statistical tests and the Friedman test have 
been used to check whether the difference (in terms of function 
errors) between NCS-C and the compared algorithms are 
statistically significant. Both tests were carried out with a 0.05 
significance level. By using the Wilcoxon test, we aimed to 
compare NCS-C with the other algorithms individually, while 
Friedman test allows us to compare all the 9 algorithms. As 
shown in the last row of Table I, NCS-C performed statistically 
significantly better than the other algorithms among the test 
problems in pairwise comparisons. Furthermore, the Friedman 
test indicated that NCS-C ranked the highest among the 9 
algorithms, as shown in the penultimate row in Table I, and a 
statistically significant difference was confirmed. 

Furthermore, the number of times an algorithm performed 
the Kth best, i.e., Top-K (K=l,2„9), were counted based on 
the pairwise two-sided Wilcoxon rank-sum statistical test and 
depicted in Fig. 1, where an algorithm is the best if its 
corresponding curve is above those of the other algorithms and 
reaches 20 (the total number of benchmark problems) with the 
smallest K. It can be observed that both NCS-C and SaDE first 
reach 20 at K= 6 , and the curve of NCS-C is never beneath that 
of SaDE. Thus, NCS-C is also the best-performing algorithm 
in this aspect. 

Taking a closer look at Table I, NCS-C was the Top-3 
algorithm on Fqs, ^" 10 - 12 , ^ 14-21 and F 24 . Among them, 
Fq, Fii_i 2 , F 16-21 and F 24 share the same feature: they 
consist of a lot of local optima and the local and global 
optima are located distantly in the search space. A search 
algorithm is more likely to be trapped in a local optimum on 
these functions, and may encounter more difficulties to identify 
better solutions once being trapped. Since NCS-C explicitly 
encourages multiple RLSs to search different regions of the 
search space, it is unlikely that all RLSs are trapped in the 
same local optimum. We believe that this is the main reason 
that accounts for its good performance on the above problems. 
This hypothesis can be further supported (albeit indirectly) 
by two examples. First, F 12 , a variant of the well-known 
Schwefel function, is known to be a difficult problem for 
which the landscape consists of several distributed promising 
areas, where the global optimum may lie in. Thus, exploration 
is particularly important for this case. The solution quality 


Submitted to IEEE Journal on Selected Areas in Communications 


6 


TABLE I: The averaged results of 9 algorithms on 20 benchmark multi-modal problems are listed in the form of ’mean ± 
standard deviation’. All the results are presented in terms of function errors, i.e., the difference between the objective function 
value of the obtained solution and that of the optimal solution to the problem. The last two rows provide the results of the 
Friedman test and Wilcoxon test, where ’w-d-l’ indicates NCS-C is superior to, not significantly different from or inferior to 
the corresponding compared algorithms. 


Algo. 

PHC 

SA 

TS 

SS 

GL-25 

SaDE 

CMA-ES 

CLPSO 

NCS-C 


2.61E+01 

3.90E+02 

7.00E+03 

2.17E+05 

2.13E+01 

4.76E+01 

O.OOE+00 

4.80E+00 

2.08E+01 


±2.35E+01 

±4.09E+01 

±1.01E+04 

±6.41E+04 

±1.02E+01 

±3.35E+01 

±0.00E+00 

±3.55E+00 

±3.61E+00 

Fr 

9.86E-04 

2.21E+00 

1.64E-02 

1.40E+00 

2.78E-02 

1.95E-02 

1.84E-03 

4.63E-01 

1.69E-02 

±2.76E-03 

±1.84E+00 

±1.59E-02 

±7.31E-02 

±3.76E-02 

±1.37E-02 

±4.59E-03 

±7.31E-02 

±1.38E-02 


2.00E+01 

2.10E+01 

2.01E+01 
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(a) (b) (c) (d) 

Fig. 2: The search trajectories of NCS-C (a), SaDE (b), CLPSO (c) and PHC (d) with N = A on the 2-D version of Fig. The contour lines represent the 
landscape of the problem. The 4 stars and squares are the locations of initial solutions and final solutions, respectively. 


TABLE II: Results of the Antenna Design Experiment. A 
means results for the corresponding case are not available in 
the literature. 




NCS-C 


31 



32 



33 



34 



35 


37-element 

PO 

-22.81 

-22.62 


- 


-19.37 

-20.49 

- 


PP 

-24.15 

-24.11 


- 


- 

- 

- 

32-element 

PO 

-22.87 

-22.65 

-22.29 

- 

- 

- 


PP 

-23.71 

-23.45 

-23.22 

- 

- 

-23.16 


achieved by NCS-C is much better than those achieved by the 
other algorithms. The second example is an illustrative one. 
The NCS-C, SaDE , CLPSO and PHC, all with population size 
4, were applied to 2-dimensional versions of the test problems. 
The trajectories of each RLS/individual were recorded and 
plotted. The results obtained on Fig are presented in Pig. 
2. As can be observed from the figure, the RLSs of NCS- 
C showed negatively correlated search behaviors and each of 
them finally reached one local (global) optimum exclusively, 
while SaDE, CLPSO and PHC all prematurely converged and 
failed to explore the majority of the search space. Similar 
phenomena have been observed on other test problems. We 
did not visualize the behavior of SS and GL-25 because 
they do not maintain a one-to-one mapping between solutions 
generated in two consecutive iterations. 

VI. Synthesis of Unequally Spaced Antenna 
Arrays 

To further evaluate NCS on real-world optimization prob¬ 
lems in the area of communications, a case study has been con- 
ducted on the SUSAA problem (3T)-|1^. Basically, SUSAA 
can be formulated as a continuous optimization problem that 
aims at finding an appropriate excitation vector and layout 
of the elements to generate desirable radiation pattern, i.e., 
to minimize the Peak Side-Lobe Levels (PSLLs). Pollowing 
previous works on this problem, the uniform amplitude ex¬ 
citation is taken into account since it can effectively reduce 
system cost and hardware implementation complexity m- 
p5| . The resultant optimization problem requires identifying 
the optimal element positions x and excitation phases (j) of 
a linear antenna array that minimizes the PSLL stated in Eq. 
(9): 


PSLL(x, 0) = max|Ai7(x, 0,6>)/Ai7(x, 0,6>o)| (9) 


where S is the space spanned by angle 0 excluding the 
mainlobe with the center at 6>o, which was set to 0°. Af(x,4>,0) 
is the array factor of the linear antenna array at angle 0 and 
can be calculated as 


F 

E . / 2,tvxa sin ( 0 ) . , \ 

-+'^*) ( 10 ) 

i=-N 

where A is wavelength. 

The same as [28], the distance between adjacent elements, 
di = Xi — Xi-i, is restricted to [0.5A, A] for reducing mutual 
coupling and preventing grating lobes |[3T|-p5l. The boundary 
of (j) is set to [0, tt]. Besides, a symmetric linear array is 
considered. Thus, elements satisfy the following constraint: 


< ^ , l<i<N (11) 

4>-i = 4>i 

NSC-C is directly applied to the above-described SUSAA 
problem to re-synthesize a 37-element symmetric linear array 
and a 32-element symmetric linear array, both of which have 
been investigated in the literature ll3T)-ll^. As suggested in 
FD -p5|, the angle resolution is set to 0.2°. Eor each of 
the four cases, NCS-C repeats 25 runs and for each run, 
NCS-C stops until the time budget of 500 thousand function 
evaluations is up. 

The average results obtained by NCS-C and the results 
reported in previous works with exactly the same number 
of function evaluations are presented in Table IT It can be 
seen that NCS-C achieved improved performance in all 4 
cases. It should be noted that no modification has been made 
to adapt NCS-C to this specific problem. NSC-C could be 
further improved with respect to SUSAA by incorporating 
search mechanisms that suits this problem better. As an 
illustration, the radiation pattern of the 37-element symmetric 
array through position-only synthesis is depicted in Eig. 3. 

VH. Conclusions and Directions for Eurther 
Research 

This paper presents a new EA for complex (typically 
non-convex) optimization problems, which are ubiquitous in 
communications as well as big data analytics. The proposed 
approach, namely NCS, is featured by its information sharing 
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Fig. 3: Radiation pattern of 37-elenient symmetric array through position- 
only synthesis. The X-axis presents the angle 6, while the Y-axis indicates 
the |Ai?(x, 0, 0)/Ai7(x, 0, 0o)| 

and cooperation schemes, which explicitly promote negatively 
correlated search behaviors in order to explore more effectively 
in the search space. Empirical results for NCS-C, i.e., an 
instantiation of NCS for continuous optimization problems, 
showed the advantages of NCS in comparison to other existing 
EAs on complex benchmark problems as well as a real-world 
problem. Eurther directions for investigations may include: 

• Theoretical studies of behaviors of NCS, e.g., the time 
complexity for NCS to achieve the optimal solution. 

• NCS for set-oriented optimization problems. Set-oriented 
optimization problems p6| require seeking a set of solu¬ 
tions that are not only of high quality but also maintain 
some sort of relationship between them. The simplest 
version might be to simultaneously find multiple distinct 
optima for a multimodal problem. Due to its search 
mechanism, we believe NCS is naturally suitable for this 
type of problems. 

• Efficient techniques for estimating the Bhattacharyya 
distance in the context of NCS. The NCS-C employs 
the Gaussian mutation operator and it is for this reason 
that the ’correlation’ between RLSs could be computed 
analytically and relatively efficiently. Although the prob¬ 
ability density function associated with a search operator 
could be estimated via sampling techniques if it could 
not be formulated mathematically, efficient techniques for 
sampling are needed. 
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